Navigation and orientation tools for speech synthesis

ABSTRACT

TTS is a well known technology for decades used for various applications from Artificial Call centers attendants to PC software that allows people with visual impairments or reading disabilities to listen to written works on a home computer. However to date TTS is not widely adopted for PC and Mobile users for daily reading tasks such as reading emails, reading pdf and word documents, reading through website content, and for reading books. The present invention offers new user experience for operating TTS for day to day usage. More specifically this invention describes a synchronization technique for following text being read by TTS engines and specific interfaces for touch pads, touch and multi touch screens. Nevertheless this invention also describes usage of other input methods such as touchpad, mouse, and keyboard.

REFERENCE TO CO-PENDING APPLICATIONS

Priority is claimed from U.S. provisional application No. 61/297,921entitled “Navigation and orientation tools for speech synthesis” filed25 Jan. 2010 and from U.S. Patent Application No. 61/347,575 entitled“Navigation and orientation tools for speech synthesis” filed 24 May,2010.

FIELD OF THE INVENTION

The present invention is in the field of navigation and orientationtools for speech synthesis.

BACKGROUND OF THE INVENTION

According to Wikipedia: Speech synthesis is the artificial production ofhuman speech. A computer system used for this purpose is called a speechsynthesizer, and can be implemented in software or hardware. Atext-to-speech (TTS) system converts normal language text into speech;other systems render symbolic linguistic representations like phonetictranscriptions into speech.

Since invented, speech technology constantly improved it's abilities.Most efforts where around imitating a human voice and fluently readingwhile the user interface and text navigating abandoned. From the userpoint of view, it is still complicated to use since current common userinterfaces are limited, for example:

The existing products/applications are far from being comfortable forthe end users.

-   -   a. In most cases, the user needs to select, by marking the text        before listening to it.    -   b. If the user stops in the middle of reading, playing text        again will start from the beginning of the marked text.    -   c. During reading there are no text pointers and the users lost        their orientation very quickly.    -   d. Not using device specific input methods and apparatuses such        as touchpad's, touch and multitouch screens making navigation        easier and more intuitive.    -   e. reading large amounts of content are almost impossible.    -   f. Current audio books navigation is cumbersome

There is a need in the art to provide new controls for text to speechnavigation and reading orientation by adding new orientation abilitiesthat will enable easy navigation through large documents, and will helpreaders to follow the text as it is being read by the TTS engine.

There is a need in the art to provide a solution that will work on anydevice Mac/PC, Mobile Smartphone or Tablets by touch, voice, mouse orkeyboard.

According to Wikipedia: A text-to-speech (TTS) system (or “engine”) iscomposed of two parts: a front-end and a back-end. The front-end has twomajor tasks. First, it converts raw text containing symbols like numbersand abbreviations into the equivalent of written-out words. This processis often called text normalization, pre-processing, or tokenization. Thefront-end then assigns phonetic transcriptions to each word, and dividesand marks the text into prosodic units, like phrases, clauses, andsentences. The process of assigning phonetic transcriptions to words iscalled text-to-phoneme or grapheme-to-phoneme conversion. Phonetictranscriptions and prosody information together make up the symboliclinguistic representation that is output by the front-end. Theback-end—often referred to as the synthesizer—then converts the symboliclinguistic representation into sound.

In one embodiment of the present invention the engine will provideportrayed text indications every time a new sentence or a new word or anew character collectively referred hereunder as the “text” is beingoutput by the back-end. Based on these indications the system will markfor example but not limited to portraying a magnifying glass over textbeing read, providing the user with orientation of the current textbeing read.

In a second embodiment of the present invention the engine will provideportrayed line indications every time the text being read, where thattext is the next line or in the previous line relatively to the textthat was read immediately before the current text. A line indication canbe for example portraying a small needle at the beginning of the linethat is currently being read.

In a third embodiment of the present invention the user may click,double click, drag, use a single touch or a multitouch gesture appliedon over the portrayed text indicator in order to start or stop playbackof the TTS engine.

In a fourth embodiment of the present invention the user may drag, use asingle touch or a multitouch gesture applied on the portrayed textindicator in order to set a new reading point for playback of the TTSengine.

In a fifth embodiment of the present invention the user may drag, use asingle touch or a multitouch gesture applied on the portrayed textindicator in order to set a new reading point for playback of the TTSengine. Where said reading point is not in the same page of the book.

SUMMARY OF THE INVENTION

In accordance with an aspect of the invention, there is provided amethod for outputting a text, comprising

-   -   a. indicating read text on a screen by using a portrayed text        indicator, for example portraying a magnifying glass on the read        text;    -   b. synchronizing the read text and audio playback of the        indicated text.    -   In accordance with an embodiment of the invention, there is        provided a method, wherein the synchronization is at word        boundary.    -   In accordance with an embodiment of the invention, there is        further provided a method, wherein the synchronization is at        sentence boundary.    -   In accordance with an embodiment of the invention, there is        still further provided a method, further comprising providing a        scroll indicator for scrolling the text by a user dragging the        scroll indicator.    -   In accordance with an embodiment of the invention, there is        still further provided a method, further comprising providing a        page flipping indicator for flipping page by means of a user        swipe gesture on the flipping indicator.    -   In accordance with an embodiment of the invention, there is        still further provided a method, further comprising displaying        the text in a screen layout that portrays a text book.    -   In accordance with an embodiment of the invention, there is        still further provided a method further comprising removing text        controls when portraying flipping of a page in the text book.    -   In accordance with an embodiment of the invention, there is        still further provided a method configured to operate on the        IPAD™, IPAD™, IPOD™, IPHONE™, Android™.    -   In accordance with an aspect of the invention, there is provided        a method for outputting a text, comprising:    -   indicating read text on a touch screen by portraying a text        indicator on the read text;    -   applying a swipe gesture by a user touch on the text indicator        to start or stop reading the text    -   synchronizing the read text and audio playback of the indicated        text.    -   In accordance with an embodiment of the invention, there is        provided a method, wherein the direction of the swipe gesture        prescribes the start or stop playback, respectively.    -   In accordance with an aspect of the invention, there is provided        a method for outputting a text, comprising:        -   indicating read text on a touch screen by portraying a text            indicator on the read text;        -   dragging the text indicator by a user touch to a different            location in the text;        -   synchronizing the read text starting from the new position            and audio playback of the indicated text.    -   In accordance with an embodiment of the invention, there is        provided a method, further comprising changing the position of a        time indicator to reflect the text that already been processed        up to the new position, wherein the time indicator indicating on        the proportion of the text that has already been processed        compared to the entire text passage for reading.    -   In accordance with an embodiment of the invention, there is        provided a method comprising:        -   indicating read text on a touch screen by portraying a text            indicator on the read text;        -   calculating the entire reading time of a text by being            proportionally to multiplying the average time required to            read a character by the total characters in the text;        -   portraying a time indicator to reflect the text that already            been processed up to the new position, wherein the time            indicator indicating on the proportion of the text that has            already been processed compared to said calculated entire            reading time.    -   In accordance with an embodiment of the invention, there is        provided a method, wherein the average time required to read a        character is configurable according to the a desired text        playback rate.

In accordance with certain other aspects of the invention there areprovided counterpart system configurations configured to perform thespecified method steps.

DESCRIPTION OF DRAWINGS

In order to understand the invention and to see how it may be carriedout in practice, embodiments will now be described, by way ofnon-limiting example only, with reference to the accompanying drawings,in which:

FIG. 1 illustrates platforms that can be used in a system in accordancewith certain embodiments of the invention

FIG. 2 a illustrates a system architecture in accordance with certainembodiments of the invention

FIG. 2 b is a screen layout of a text and associated controls inaccordance with certain embodiments of the invention

FIGS. 3 a, 3 b, 3 c, and 3 d are screen layouts of a text and associatedcontrols in accordance with certain embodiments of the invention

FIG. 4 is a screen layout of a text and associated controls inaccordance with certain embodiments of the invention

FIGS. 5 a and 5 b are screen layouts of displayed controls in accordancewith certain embodiments of the invention

FIGS. 6 a, 6 b, 6 c, 6 d, and 6 e are screen layouts of displayedcontrols in accordance with certain embodiments of the invention

FIG. 7 is a screen layout of a text and associated controls inaccordance with certain embodiments of the invention

FIG. 8 illustrates a flow chart of a sequence of operations in a systemin accordance with certain embodiments of the invention

FIG. 9 illustrates a flow chart of a sequence of operations in a systemin accordance with certain embodiments of the invention; and

FIG. 10 illustrates a flow chart of a sequence of operations in a systemin accordance with certain embodiments of the invention.

The subject matter of the present application can have features ofdifferent aspects described above, or their equivalents, in anycombination thereof, which can also be combined with any feature/s ofthe subject matter described in the detailed description of embodimentspresented below, or their equivalents.

DETAILED DESCRIPTION OF THE INVENTION

The current invention describes a system and methods for users that needto read text from a display. This system is useful for mobile users thatwould like the computer to read the text for them since they are inconstant movement, say walking, driving, on a train, were they oftenneed to move their eyes from the display and therefore lose the lastpoint they read in the text, making it impossible to have a continuousexperience. Also when reading large text even when stationary there is aneed for a pointer, instead of using the finger or the mouse, the systemis reading the text for the user and the current word and line text isbeing highlighted keeping the listener with visual orientation to thetext being read. It seems that readers that are reading through textthat it not written in their mother tongue or readers that are nothighly skilled in reading for example kids in kindergarten and kidsduring their first years as students find it hard to pronounce some ofthe words and generally reading slower than usual will find the TTSsystem with Navigation and Orientation tools detailed hereunder the userreads through the text faster, and easier while also expending hislanguage skills.

According to FIG. 2 a the system includes portrayed text indicators, inthis case a word indicator 207 and a portrayed line indicator 208. Theseindicators help the user to immediately focus on the text and keep theuser in context of the text being read. The portrayed word indicator 207changes to the next word as the TTS engine progress through the text.The text will scroll to be aligned with the portrayed line indicatorwhen a new line is going to start being read by the TTS engine. In thiscase since the line indicator is in a fixed place on the screen the userknows exactly were to look for the text on the display. The controlbutton has navigation buttons 219 and 211 helping the user to moveforward and backward in the text.

The Timeline 217 represents the duration it will take reading throughthe entire text, the knob 214 represent the current time of the textbeing read. For each word that is being read by the TTS engine thesystem is generating 1) A portray indicating the word being read 207, 2)portray indicating the line of the word being read 208 and, 3) Timeindication by moving the knob 214 to the respective point in time ofthat word in the entire reading sequence. Also the time elapsed 220,time remaining 221, and page number 215 is updated accordingly.

The user can at any time see the current time in the reading 220 and thereading time 221 to complete the reading of the text. These indicationsare imperative for the user to understand where he is in the process ofreading and how much time remained for the reading, and plan his timeaccordingly. Additionally the timeline has a knob 214 that representsthe current time of the text being read, that knob 214 is moving alongthe timeline as the reading progresses, giving the user the feeling ofcontinuity and that he is in progress while listening to the text, theprogress bar gives the user further indication of the pace the text isbeing read and since progress is captured by the mind as somethingpositive, it actually encourages the user to keep on listening to thetext and complete the task of listening to the entire text. The knob 214is also used for navigation by scrolling the knob 214 along the timeline the user can access any point in the text. When scrolling the knobthe text in the display area 206 is moved accordingly keeping sync withthe knob 214.

The system may be operated in different ways, in some embodiments of thepresent invention the system maybe a generic capability of the devicesystem (also known as a system service, drive, resident, etc.) where theuser can use the system to read for example: his emails, word documents,pdf files and webpage's for the user and the system will read the textfor the user including the highlight of the words, lines, timeline andcontrol buttons within his application. In another embodiment of thepresent invention the system is implemented as an application where theuser paste clips of at least text copied for example from his emails,word documents, pdf files and webpage's and then ask the application toread through the text using the highlight of the words, lines, timelineand control buttons.

Note that the description above was provided for understanding the needand typical use of the system of the invention. The invention is by nomeans bound by this exemplary description which is provided forillustrative purposes only.

Bearing this in mind, attention is drawn to FIG. 1 which demonstrates aNAVIGATION AND ORIENTATION TOOLS FOR SPEECH SYNTHESIS implemented on aPC, MAC, Tablet, and Smart phone. The mouse, keyboard, touch screen,touch gestures 101, stylus 103 and voice activated 102 are examples ofinput devices enabling pointing and selecting referred here under as“selection”, “selections”, “selected”, “selects”, etc. Where a mouse,keyboard, touch screen, touch gestures 101, stylus 103 and voiceactivated 102 are examples of input devices that enables text scrollingreferred hereunder as “scroll”, “scrolls”, “scrolling”, etc. Whenselecting controls on the screen buttons or menus will be refereedcollectively herein as “buttons”. Such buttons can be operated by touchscreen, touch gestures 101, stylus 103, mouse, keyboard, and voicecontrol 102.

FIG. 2 a shows a text-to-speech (TTS) system (or “engine”) is composedof two parts: a front-end 202 and 203 and a back-end 205. The front-end202 has two major tasks. First, it converts raw text containing symbolslike numbers and abbreviations into the equivalent of written-out words.This process is often called text normalization, pre-processing, ortokenization. The front-end then assigns phonetic transcriptions to eachword, and divides and marks the text into prosodic units, like phrases,clauses, and sentences. The process of assigning phonetic transcriptionsto words 203 is called text-to-phoneme or grapheme-to-phonemeconversion. Phonetic transcriptions and prosody information togethermake up the symbolic linguistic representation that is output by thefront-end 203. The back-end 205—often referred to as thesynthesizer—then converts the symbolic linguistic representation intosound.

The present invention also has a Navigation and Orientation Unit 201 andSynchronization Unit 204. The Synchronization unit 204 is responsiblefor taking the output of the front-end 203 and feed it synchronically tothe Wave Form Generation 205 and the Navigation and Orientation Unit201. In one embodiment of the present invention the Synchronization unit204 may Synchronize the Wave Form Generation 205 and the Navigation andOrientation Unit 201 for every new word. In another embodiment of thepresent invention the Synchronization Unit 204 may Synchronize the WaveForm Generation 205 and the Navigation and Orientation Unit 201 forevery character, line, sentence, paragraph, bookmark, or page. Inanother embodiment of the present invention the Synchronization Unit 204may Synchronize the Wave Form Generation 205 and the Navigation andOrientation Unit 201 for every segment of the text as defined by theapplication. Synchronization is achieved for example, in the case werethe Synchronization Unit 204 synchronizes for every word, by having theSynchronization Unit 204 waiting for the word to be played by the WaveForm Generation 205, and only then continue to the next word if suchword exists. By waiting for the word to be played the system achievesynchronization.

The Navigation and Orientation Unit 201 has Human Interface—UI, thatenables the user to interact with the displayed text and other UI partssuch as buttons. In one embodiment of the present invention the user maystart a TTS session by ordering the Text Analysis Unit 202 to startreading text by selecting a “Play” button. In another embodiment of thepresent inventions the user interacts with the Navigation andOrientation Unit 201 UI, the Navigation and Orientation Unit 201 maychange the text feed to the Text Analysis Unit 202 and start a new TTSsession.

FIGS. 3 a-d show a portrayed text indicator 302 that is portrayed on thetext 301 with as a magnifying glass effect. The magnifying glass 302surrounds at least one character in the text 301. In a preferredembodiment of the present invention the magnifying glass 302 surroundsat least one word. In another embodiment of the present invention themagnifying glass 302 is aligned to the direction of the text reading,for example when TTS Engine is reading English the magnifying glass 302will be aligned to the left of the word that is currently being read. Inyet another preferred embodiment of the present invention the magnifyingglass 302 will not jump from word to word but rather will animate fromits position on word 302 to its new position on word 308, giving theuser a progressive experience. By animating the magnifying glass 302 theuser feels like the text is being followed with a finger in continuousmotion. In another embodiment of the present invention the when themagnifying glass 313 moves from its current line FIG. 3 c line 2 to anew line FIG. 3 d line 3, it will animate from the last word of the line313 to the beginning of the first word in the next line 319. FIG. 3 cand FIG. 3 d further show a line indicator 314 and 318 portrayed as atriangle. In a preferred embodiment of the present invention the lineindicator 314 looks like a needle that points to the current line. Inyet another preferred embodiment of the present invention the lineindicator 314 will animate when moving from line FIG. 3 c line 2 to lineFIG. 3 d line 3.

In one embodiment of the present invention the portrayed text indicatoranimation, in this case the portrayed magnifying glass over words 302and 308, will start when the synchronization unit 204 will send “word isabout to start” event to the Navigation and orientation tool unit 201.The “word is about to start” event is fired immediately after thewaveform generator 205 completed synthesizing the current word 302. Thetime between the “word is about to start” event and the time thewaveform generator will start synthesizing the next word 308 is the timeduration for the magnifying glass to animate between the current word302 to the next word 308. For example in case the time gap in betweenwords is 200 ms, the time gap between the “word is about to start” eventand actual speech synthesis of that word will be 200 ms, and that wouldalso be the time for the magnifying glass to animate from word 302 toword 308. In another embodiment of the present invention during the timegap between the “word is about to start” event and actual speechsynthesis of that word the word indicator and the line indicator willanimate from their current position 313, 314 to their new position 318,319.

FIG. 4 illustrates a user that interacts with the portrayed textindicator 402, in this case the portrayed magnifying glass. In oneembodiment of the present invention the user may click, double click,drag, touch, multitouch, use a single touch or a multitouch gestureapplied on the magnifying glass 402 in order to start playback of theTTS engine. In a preferred embodiment of the present invention in acomputer connected to a mouse or similar apparatus the user shall usedouble click on the magnifying glass 402 in order to start playback ofthe TTS engine. In another preferred embodiment of the present inventionin a computer connected to a mouse or similar apparatus the user shalluse a single click on the magnifying glass 402 in order to stop playbackof the TTS engine. In another embodiment of the present invention when akeyboard is connected the user may use the spacebar to toggle start andstop playback of the TTS engine. In yet another preferred embodiment ofthe present invention a device with a touch pad, touch screen, multitouch screen, or similar apparatus the user shall user a swipe gesture403 in the direction of reading on the magnifying glass 402 in order tostart playback of the TTS engine. For example, in English the user willuse a swipe gesture from left to right applied on the magnifying glass402 in order to start reading. In one embodiment of the presentinvention the user may click, double click, drag, touch, multitouch, usea single touch or a multitouch gesture applied on the magnifying glass402 in order to stop playback of the TTS engine. In yet anotherpreferred embodiment of the present invention a device with a touchpad,touch, multi touch screen or similar apparatus the user shall use aswipe gesture 403 opposite to the direction of reading on the magnifyingglass 402 in order to stop playback of the TTS engine. For example inEnglish the user will use a swipe gesture from right to left to stopreading. In another embodiment of the present invention when the userstops the playback of the TTS engine the magnifying glass r 402 placesin the entire text will be saved in memory. When resuming reading by theTTS engine the TTS engine will resume playback from the saved positionenabling precise resuming.

FIGS. 5 a-b Illustrate a case where the user drags, uses a single touchor a multitouch drag gesture applied on the portrayed text indicator502, in this case the portrayed magnifying glass, in order to set a newreading point for playback of the TTS engine. The new location the userset by the user maybe anywhere on the screen where the text 500 playedby the TTS engine. In a preferred embodiment of the present invention ina computer connected to a mouse or similar apparatus the user shall usea dragging method on the magnifying glass 502 to set a new reading pointfor playback of the TTS engine. Dragging means pointing to themagnifying glass 502, pressing a mouse button down and moving themagnifying glass using the mouse to a new location 509 over the text 500while the mouse button is being pressed. Releasing the mouse buttonmeans that dragging is completed. The magnifying glass 509 will beplaced on new text setting a new reading point for playback of the TTSengine. When the magnifying glass 502 is dragged from one positionplaced on one line to a new position 509 placed on a different line, theline indicator 501 will also change its position pointing to the newline 507. In another embodiment of the present invention when themagnifying glass 502 is dragged from one position to a new position 509,the current time indicator 504 and the time elapsed 512 and timeremaining 506 will also change their position and value respectivelyrepresenting a new current time 508, and new time elapsed 513 and timeremaining 510.

In yet another preferred embodiment of the present invention a devicewith a touch, multi touch screen or similar apparatus the user shall usea drag by touching the magnifying glass 502 and move it to a newlocation 509 on the text in order to set the current position for textto be read by the TTS engine. In another embodiment of the presentinvention when the user drag the text indicator 502 using his finger 503to a new location 509 the magnifying glass 502 will follow the finger503 while it is being drag to the new location 509. For example inEnglish the user will use his finger 503 touching the magnifying glass502 and then the user will drag his finger 503 over the touch screen toa new location 509 over the text. When the user is removing his fingerfrom the screen (i.e not touching it) that will mean that dragging iscompleted. The magnifying glass 502 will be placed on the text setting anew reading 509 point for playback of the TTS engine.

Drag gesture may be double tap followed by a drag motion, or a singletap and hold followed by a drag motion.

FIGS. 6 a FIG. 6 b, and FIG. 6 c illustrate a case were the usernavigates through the text using a mouse dragging, touch, multitouch, asingle touch, or a multitouch gesture applied on the portrayed textindicator 601, in this case the portrayed magnifying glass, in order toset a new reading point for playback of the TTS engine, where thatplayback point in the text 603 is not visible to the user at the timethe users starts navigation. There are three methods illustrated inFIGS. 6 a, 6 b, and 6 c.

FIG. 6 a illustrates a case were the page can be scrolled to anydirection 610. In one embodiment of the present invention the usernavigates through the text 603 using mouse dragging, single touchdragging, or a multitouch dragging applied on the text indicator 601.When the mouse pointer, finger or fingers are dragged beyond the textarea border 604, the text is scrolled, revealing new text 615 that wasnot visible at the time the user started the navigation, When the userreleases the mouse button, finger, or fingers it signals that thedragging is completed. The text indicator 601 will be placed on new text617, setting a new reading point for playback of the TTS engine.

In another embodiment of the present invention when the user drag thetext indicator 601 using his finger 608, the magnifying glass 601 willfollow the finger 608 while it is being dragged. When the magnifyingglass 601 is dragged from one position placed on one line to a newposition 617 placed on a different line, the line indicator portray 602will also change its position pointing to the new line 614. In anotherembodiment of the present invention when the magnifying glass 601 isdragged from one position to a new position 617, the current timeindicator 606 the time elapsed 622 and time remaining 623 will alsochange their position and value respectively representing a new currenttime 612, and new time elapsed 625 and time remaining 625.

In another embodiment of the present invention when the user drag themagnifying glass 601 using his finger 608, the magnifying glass 617 willfollow the finger 620 while it is being dragged. When the magnifyingglass 601 is dragged from one position placed on one line to a newposition 617 placed on a different line, the line indicator portray 602will also change its position pointing to the new line 614. In anotherembodiment of the present invention when the magnifying glass 601 isdragged from one position to a new position 617, the current timeindicator 606 and the time elapsed 622 and time remaining 623 will alsochange their position and value respectively representing a new currenttime 612, and new time elapsed 624 and time remaining 625.

FIG. 6 c, illustrates a case were the metaphor used for the textpresentation is portrayed as a book, were the book is made of more thanone page. The illustration shows page flipping areas 626. When theseareas are clicked, double clicked, dragged, touched, multitouched, orapplied with a single touch or a multitouch gesture the page will turnby portraying a page curl and turn over, using a multi frame animationto a different page, and the text 627 will change to a different text.In one embodiment of the present invention when the user 632 drags themagnifying glass 631 (using mouse dragging, single touch dragging, or amultitouch dragging) over the page flipping areas the page 627 will turnby portraying a page curl and turn over, using a multi frame animationto a different page revealing new text 626 that was not visible at thetime the user started the navigation, When the user 632 releases themouse button, finger, or fingers it signals that the dragging iscompleted. The magnifying glass 631 will be placed on a new text,setting new reading point for playback of the TTS engine.

FIG. 6 d and FIG. 6 e, illustrate a case were the metaphor used for thetext presentation is portrayed as a book, were the book is made of morethan one page and a time line 647. When the current time indicator 648is moved using mouse dragging, touch dragging, multitouched dragging, orapplied with a single touch or a multitouch gesture the page 634 willchange to a different page 639 revealing the text that should bedisplayed in the new point of time 646. In one embodiment of the presentinvention when the user 638 drags the portrayed text indicator, in thiscase the portrayed magnifying glass 637 (using mouse dragging, singletouch dragging, multitouch dragging, or touchpad dragging) over thetimeline area 647 the page 634 will change to a different page 639revealing new text that was not visible at the time the user starteddragging, when the user 645 is already in a different page 639 andreleases the mouse button, finger, or fingers it signals that thedragging is completed. The magnifying glass 646 will be placed on a newtext in the different page 639, setting new reading point for playbackof the TTS engine.

Drag gesture may be double tap followed by a drag motion, or a singletap and hold followed by a drag motion.

FIGS. 7 a-b illustrates a case were the metaphor used for the textpresentation is portrayed as a book, were the book is made of more thanone page and may have a time line and other controls such as but notlimited to play/stop button, skip forward backward buttons, lineindicator in this case the portrayed triangle, text indicator in thiscase the portrayed magnifying glass, find controls, text size controls,and other navigation controls 702. In one embodiment of the presentinvention when the user click, double click, touch, multitouch, or applytouch or multitouch gesture on the page flipping some or all of thecontrols 702 on the screen will disappear, an animation will occur andthe controls that disappeared will reappear once the animation is done.In a preferred embodiment of the present invention when the user click,double click, touch, multitouch, or apply touch or multitouch gesture onthe page flipping areas 702 some or all of the controls on the screenwill disappear, a page flipping animation will occur and the controlsthat disappeared will reappear once the animation is done.

In some embodiments of the present invention (not shown in the figures)in a book format, when the TTS engine reads the last word of a page thepage will turn to a different page and the TTS engine will continuereading from the first word in the new page. In case the text layout isin scrolling format, when the TTS engine reach the last word in thevisible screen area or When the TTS engine nearly reach the last word ofthe visible screen area the text on the screen will scroll revealing newtext to be read by the TTS engine and enable the user continuousreading. In some embodiments of the present invention when the TTSengine on stop mode and the user is scrolling the text or flipping to anew page a new reading point will be set automatically in a visibleplace in the text viewing area. In a preferred embodiment of the presentinvention when the TTS engine on stop mode and the user is scrolling thetext or flipping to a new page a new reading point will be setautomatically at the first word of the text that is currently visible inthe text viewing area.

FIG. 8. is a flow chart for initializing the Synchronization Unit 204,and Navigation and Orientation Unit 201. In 801 the system calculatesthe reading time it will take the TTS engine 200 to read through thetext. The value of the total reading time will be presented in remainingtime 221. The Navigation and Orientation unit is initialized 802including display area, word, and line indicators. The time line is alsoinitialized. If bookmarks are present they are rendered 803 for thetimeline 217 representing the bookmarks associated with the entire text.If bookmarks are present they are also rendered 804 for the textpresented in the display area 206. Other display parameters areinitialized 805 for example elapsed time, current word, current line,font, font size, page number, search string, search results, etc. In oneembodiment of the present invention calculating the entire text readingtime 801 is done by multiplying the average time of reading a singlecharacter multiplied by the total number of characters of the entiretext. In another embodiment of the present invention the average time ofreading a single character is depended on the TTS engine reading speed.For example when TTS engine is set to read slow the average characterreading time may be 90 ms and when the TTS engine is set to read thetext fast the average charter reading time my be 40 ms.

FIG. 9 is a flow chart showing an example of a Synchronization Unitprocess. 901 gets the text to be displayed and synchronized with the TTSengine 200. 902 gets “a word is about to start” event including the nextword that should be displayed and synthesized by the TTS engine 200. 903is calculating the display parameters for that word. Display parametersat least one of the following: 1) the word for highlighting in a line,2) determining the location of the word in a line, 3) determiningposition of word in timeline. 904 is transferring the word and displayparameters to be displayed by the Navigation and Orientation Unit 201.905 Animating at least one of the following 1) the movement of the wordindicator from the previous word to the next word 2) the movement of theline indicator to the following line 3) the current time knob over thetime line to the new time representation of the next word. 906 transferthe word to the wave form generation unit 205 to start reading throughthe word. 907 the Synchronization Unit is waiting for the word to beplayed. By waiting for the word to be played the system achievessynchronization. 908 goes back to 1002, to get the next word that shouldbe displayed and synchronized with the TTS engine 200. If 902 determinesthat there are no further words to be displayed and synchronize with theTTS engine 200, the process stops. In a preferred embodiment of thepresent invention in order to achieve precise synchronization theanimate display 905, will be completed first, and immediately after theword will be synthesized by the wave form generation unit 205.

FIG. 10 is an example of a detailed flow chart of 903—Calculates displayparameters for next word. 1001 obtains access to the entire text. 1002determines the next word that needs to be displayed and synchronizedwith the TTS engine 200. 1003 is calculating the highlight of the nextword. 1004 is determining if the word is in a new line and therefore theline indicator 208 should be updated for that word. 1005 calculates therespective point in time of that word in the entire reading sequence.The result of that calculation is used for determining the position ofthe knob 214 over the timeline 217 and for calculating and displayingthe elapsed 220 and reaming remaining time 221.

In a preferred embodiment of the present invention Get next word 1002will be triggered by a “word is about to start” event generated by thesynchronization unit 204.

The present invention has been described with a certain degree ofparticularity, but those versed in the art will readily appreciate thatvarious modifications and alterations may be carried out, withoutdeparting from the scope of the following Claims:

1. A method for outputting a text, comprising a. indicating read text ona touch screen by portraying a text indicator on the read text; b.Synchronizing the read text and audio playback of the indicated text. 2.The method according to claim 1, wherein the synchronization is at wordboundary.
 3. The method according to claim 1, wherein thesynchronization is at sentence boundary.
 4. The method according claim1, further comprising providing a scroll indicator for scrolling thetext by a user dragging the scroll indicator.
 5. The method according toclaim 1, further comprising providing a page flipping indicator forflipping page by means of a user swipe gesture on the flippingindicator.
 6. The method according to claim 1, further comprisingdisplaying the text in a screen layout that portrays a text book.
 7. Themethod according to claim 6, further comprising removing text controlswhen portraying flipping of a page in the text book.
 8. The methodaccording to claim 1 configured to operate on any of the followingdevices: IPAD™ IPAD™ IPOD™ IPHONE™ Android™ Kindle™ Nook™
 9. A methodfor outputting a text, comprising a. Indicating read text on a touchscreen by portraying a text indicator on the read text; b. Applying aswipe gesture by a user touch on the text indicator to start or stopreading the text c. Synchronizing the read text and audio playback ofthe indicated text.
 10. The method according to claim 9, wherein thedirection of the swipe gesture prescribes the start or stop playback,respectively.
 11. A method for outputting a text, comprising a.Indicating read text on a touch screen by portraying a text indicator onthe read text; b. Dragging the text indicator by a user touch to adifferent position of the text; c. Synchronizing the read text startingfrom the new position and audio playback of the indicated text.
 12. Themethod according to claim 11, further comprising changing the positionof a time indicator to reflect the text that already been processed upto the new position, wherein the time indicator indicating on theproportion of the text that has already been processed compared to theentire text passage for reading.
 13. A method according to claim 11,comprising: a. Indicating read text on a touch screen by portraying atext indicator on the read text; b. Calculating the entire reading timeof a text by being proportionally to multiplying the average timerequired to read a character by the total characters in the text; c.Portraying a time indicator to reflect the text that already beenprocessed up to the new position, wherein the time indicator indicatingon the proportion of the text that has already been processed comparedto said calculated entire reading time.
 14. The method according toclaim 13, wherein said average time required to read a character isconfigurable according to the desired text playback rate.